Spezielle Anforderungen bei der Evaluierung von Patent-Retrieval-Systemen

Within the area of specialized information, the patent domain is considered to be quite unique, because it has a number of characteristics, which long for a change or the adaption of traditional evaluation methods. This fact is, for example, shown by the results of the Intellectual Property Track, which since 2009 takes place in the context of the CLEF evaluation campaign. This paper presents the results gained within the above mentioned track. Furthermore, the consequences for the evaluation of patent retrieval systems are pointed out. 1 Cross-Language Evaluation Forum: http://www.clef-campaign.org 198 Daniela Becks, Thomas Mandl, Christa Womser-Hacker